On the uniqueness of weights in single-layer perceptrons
نویسندگان
چکیده
In this paper the geometric formulation of the single layer perceptron weight optimization problem previously described by Coetzee et al. (1993, 1996) is combined with results from other researchers on nonconvex set projections to describe sufficient conditions for uniqueness of weight solutions. It is shown that the perceptron data surface is pseudoconvex and has infinite folding, allowing for the specification of a region of desired vectors having unique projections purely in terms of the local curvature of the data surface. No information is therefore required regarding the global curvature or size of the data surface. These results in principle allow for a posteriori evaluation of whether a weight solution is unique or globally optimal, and for a priori scaling of desired vector values to ensure uniqueness, through analysis of the input data. The practical applicability of these results from a numerical perspective is evaluated on some carefully chosen examples.
منابع مشابه
A Constructive Algorithm to Determine the Feasibility and Weights of Two-Layer Perceptrons for Celled Decision Regions
Necessary and sufficient conditions for implementing particular decision regions by multi-layer perceptrons have been presented in recent studies. In this paper, from a viewpoint of engineering, a constructive algorithm is proposed to implement celled decision regions using two-layer perceptrons without any training procedure. The algorithm examines the feasibility of a celled decision region a...
متن کاملOn Implementation of Nested Rectangular Decision Regions by Multi-layer Perceptrons I: Algorithm
There are three papers in a series of discussions related to the partitioning capabilities on nested rectangular decision regions using multi-layer perceptrons. We propose a constructive algorithm, called the up-down algorithm, to realize the nested rectangular decision regions. The algorithm determines the weights easily and can be generalized to solve other decision regions with the propertie...
متن کاملModeling of measurement error in refractive index determination of fuel cell using neural network and genetic algorithm
Abstract: In this paper, a method for determination of refractive index in membrane of fuel cell on basis of three-longitudinal-mode laser heterodyne interferometer is presented. The optical path difference between the target and reference paths is fixed and phase shift is then calculated in terms of refractive index shift. The measurement accuracy of this system is limited by nonlinearity erro...
متن کاملReducing Communication for Distributed Learning in Neural Networks
A learning algorithm is presented for circuits consisting of a single layer of perceptrons. We refer to such circuits as parallel perceptrons. In spite of their simplicity, these circuits are universal approximators for arbitrary boolean and continuous functions. In contrast to backprop for multi-layer perceptrons, our new learning algorithm – the parallel delta rule (p-delta rule) – only has t...
متن کاملA learning rule for very simple universal approximators consisting of a single layer of perceptrons
One may argue that the simplest type of neural networks beyond a single perceptron is an array of several perceptrons in parallel. In spite of their simplicity, such circuits can compute any Boolean function if one views the majority of the binary perceptron outputs as the binary output of the parallel perceptron, and they are universal approximators for arbitrary continuous functions with valu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE transactions on neural networks
دوره 7 2 شماره
صفحات -
تاریخ انتشار 1996